Waveguide mode solver based on Neumann-to-Dirichlet operators and boundary integral equations

For optical waveguides with high index-contrast and sharp corners, existing full-vectorial mode solvers including those based on boundary integral equations typically have only second or third order of accuracy. In this paper, a new full-vectorial waveguide mode solver is developed based on a new formulation of boundary integral equations and the so-called Neumann-to-Dirichlet operators for sub-domains of constant refractive index. The method uses the normal derivatives of the two transverse magnetic field components as the basic unknown functions, and it offers higher order of accuracy where the order depends on a parameter used in a graded mesh for handling the corners. The method relies on a standard Nyström method for discretizing integral operators and it does not require analytic properties of the electromagnetic field (which are singular) at the corners.